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Ascending  Stairway  Modeling: 

A  First  Step  Toward  Autonomous  Multi-Floor  Exploration 

Jeffrey  A.  Delmerico,  Jason  J.  Corso,  David  Baran,  Philip  David,  and  Julian  Ryde 


Abstract — Many  robotics  platforms  are  capable  of  ascending 
stairways,  but  all  existing  approaches  for  autonomous  stair 
climbing  use  stairway  detection  as  a  trigger  for  immediate 
traversal.  In  the  broader  context  of  autonomous  exploration, 
the  ability  to  travel  between  floors  of  a  building  should  be 
compatible  with  path  planning,  such  that  the  robot  can  traverse 
a  stairway  at  a  time  that  is  appropriate  to  its  navigation  goals. 
No  system  yet  presented  is  capable  of  both  localizing  stairways 
on  a  map  and  estimating  their  properties,  functions  that  in  com¬ 
bination  would  enable  stairways  to  be  considered  as  traversable 
terrain  in  a  path  planning  algorithm.  We  propose  a  method  for 
modeling  stairways  as  objects  and  localizing  them  on  a  map, 
such  that  they  can  be  subsequently  traversed  if  they  are  of 
dimensions  that  the  robotic  platform  is  capable  of  climbing.  Our 
system  consists  of  two  parts:  a  computationally  efficient  detector 
that  leverages  geometric  cues  from  depth  imagery  to  detect  sets 
of  ascending  stairs,  and  a  stairway  modeler  that  uses  multiple 
detections  to  infer  the  location  and  parameters  of  a  stairway 
that  is  discovered  during  exploration.  This  video  demonstrates 
the  performance  of  the  system  in  a  number  of  real-world 
situations,  modeling  and  localizing  a  variety  of  stairway  types 
in  both  indoor  and  outdoor  environments. 

I.  Introduction 

When  exploring  a  new  space,  humans  typically  investigate 
the  places  that  are  easy  to  get  to  first,  and  only  later  move  into 
less  accessible  areas.  In  the  context  of  a  multi-floor  building, 
this  translates  to  people  fully  exploring  the  ground  floor  of 
the  building  before  traveling  via  stairs  or  elevators  to  other 
floors  that  require  more  effort  to  reach.  A  logical  approach 
to  autonomous  exploration  in  a  multi-floor  building  would 
also  follow  a  similar  strategy:  explore  the  accessible  areas 
on  the  current  floor  before  undertaking  the  more  difficult 
task  of  transitioning  to  another  floor  to  find  less  accessible 
areas.  Existing  approaches  for  stair  detection  serve  to  initiate 
their  traversal  as  soon  as  they  are  detected,  which  is  not 
compatible  with  the  aforementioned  approach  to  building 
exploration.  None  of  these  methods  have  been  incorporated 
into  a  comprehensive  multi-floor  exploration  approach. 

The  restriction  of  robots  to  single  floors  of  a  building 
or  outdoor  areas  free  of  abrupt  elevation  changes  presents 
a  significant  limitation  to  real-world  applications,  such  as 
whole-building  mapping  and  rescue  scenarios.  Our  work 
seeks  a  solution  to  this  problem  and  is  motivated  by  the  rich 
potential  of  an  autonomous  ground  robot  that  can  climb  stairs 
while  exploring  a  multi-floor  building.  Our  proposed  solution 
to  this  problem  is  a  system  to  detect  and  localize  stairways 
in  the  environment  during  the  process  of  exploration,  and 
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Fig.  1.  Occupancy  grid  map  with  detected  and  modeled  stairway  super¬ 
imposed  (upper  left). 

model  any  identified  stairways  in  order  to  determine  if  they 
are  traversable  by  the  robot.  With  a  map  of  the  environment 
and  estimated  locations  and  parameters  of  the  stairways,  the 
robot  could  plan  a  path  that  traverses  the  stairs  in  order  to 
explore  the  frontier  at  other  elevations  that  were  previously 
inaccessible.  Autonomous  multi-floor  exploration  is  a  new 
behavior  for  ground  robots,  and  we  present  this  video  as 
a  summary  of  our  first  steps  toward  the  realization  of  that 
capability. 

A.  Background 

Other  systems  have  been  proposed  for  related  tasks,  but 
no  existing  work  approaches  the  problem  in  the  context  of 
the  aforementioned  scenario.  Bansal  et  al.  [1]  detect  and 
localize  stairways  while  constructing  a  map,  but  do  not  assess 
traverability.  Several  methods  [2],  [3],  [4]  perform  detection 
and  traversal,  but  do  not  model  the  pose  or  location  of  the 
stairway  and  and  simply,  immediately  initiate  a  climbing 
mechanism.  Although  these  capabilities  are  related  to  our 
problem  scenario,  immediate  climbing  is  not  necessarily 
compatible  with  a  mapping  task.  Path  planning  for  multi¬ 
floor  exploration  should  take  the  stairway  into  account  as 
a  portal  to  more  unexplored  regions,  but  traversing  stairs 
immediately  upon  a  single  detection  makes  exploring  the 
low-cost  frontiers  of  the  original  floor  more  difficult  and  may 
fail  if  the  detection  was  erroneous. 

B.  Methods 

We  employ  a  computationally  lightweight  stair  edge  de¬ 
tector  that  operates  by  finding  lines  of  range  discontinuity  in 
depth  imagery  (here  produced  by  a  Microsoft  Kinect  sensor) 


Fig.  2.  Results  of  several  runs  from  our  datasets  showing  the  stairway 
model  superimposed  on  a  rendered  building  model,  a  marked-up  image 
showing  a  detection,  and  a  view  of  the  map  and  model  from  the  robot’s 
perspective. 

that  match  the  signature  of  sets  of  stairs:  vertically  clustered 
sets  of  nearly  parallel  lines.  Point  clouds  corresponding 
to  the  detected  stair  edges  are  extracted  and  aggregated 
together,  with  approximate  alignment  provided  by  the  robot’s 
estimated  pose  from  mapping.  To  this  aggregated  point  cloud 
we  fit  a  generative  stairway  model,  and  we  assume  a  non¬ 
spiral  staircase.  In  testing,  we  have  observed  that  the  system 
is  capable  of  detecting  stairways  with  non-parallel  steps, 
for  example  a  stairway  with  a  90°  turn  over  several  steps. 
However,  many  ground  robots  are  not  capable  of  traversing 
tight  spiral  stairs,  and  so  we  do  not  focus  on  these  types. 

The  stairway  is  represented  as  a  single  object:  an  in¬ 
clined  plane  constrained  by  a  bounding  box,  with  parallel 
stair  edges  lying  in  the  plane.  This  model  is  parameterized 
by  the  bounding  box  centroid  (Bx,By,Bz)  and  dimensions 
(H,W,D),  pitch  relative  to  the  ground  plane  (P),  and  step 
dimensions  ( h,d ).  We  assume  that  stair  steps  are  approxi¬ 
mately  parallel  to  the  ground  plane,  so  the  bounding  box  top 
and  bottom  are  parallel  to  the  XY  plane.  For  an  inclined 
plane  model  of: 

ax  +  by  +  cz  +  d  =  0  (1) 

the  planes  constituting  the  bounding  box  are  given  by: 

z  =  Bz±—  (2) 

a(x  -  Bx)  +  b(y  -  By)  ±  ^  (Va2  +  62)  =  0  (3) 

-cb(x  -  Bx)  +  ca(y  -  By)  ±  ^  ( c\ / a2  +  62)  =  0  (4) 

for  the  top/bottom,  front/back,  and  sides,  respectively.  Here, 
the  pitch  P  is  computed  as  the  dihedral  angle  of  the  planar 
model  and  the  ground  plane:  P  =  arccos  (a,  6,  c)  •  (0,  0, 1). 
As  new  observations  are  added  to  the  aggregated  point 
cloud,  the  model  parameters  are  re-estimated,  outliers  are 
removed,  and  well- supported  stair  edges  are  used  to  infer 
the  dimensions  of  each  step. 

Work  on  a  comprehensive  system  for  multi-floor  explo¬ 
ration  is  ongoing.  Current  investigations  include  developing 
techniques  for  robustly  discovering  all  stairways  in  the 
environment  and  path  planning  for  multi-floor  exploration. 

II.  Results 

Our  video  sequences  show  the  evolution  of  the  model 
over  multiple  observations,  the  refinement  of  the  parameter 


TABLE  I 

Table  of  model  step  estimates  and  ground  truth  values  (GT) 


Trial 

Height  (m) 

Depth  (m) 

Width  (m) 

Pitch  (°) 

B.l  Front 

0.174 

0.257 

0.977 

34.0 

GT 

0.196 

0.254 

0.965 

37.6 

B.l  Rear 

0.166 

0.252 

0.715 

33.0 

GT 

0.196 

0.254 

0.965 

37.6 

B.3 

0.169 

0.245 

0.689 

35.4 

GT 

0.192 

0.263 

1.015 

36.2 

Davis  Front 

0.175 

0.323 

1.076 

28.3 

GT 

0.181 

0.305 

1.226 

30.7 

Davis  Rear 

0.169 

0.311 

1.048 

29.4 

GT 

0.165 

0.292 

1.175 

29.5 

Mean  Error 

0.017 

0.012 

0.173 

2.3 

Std.  Dev. 

0.01396 

0.01568 

0.1285 

1.876 

estimates  with  each  model  fitting,  and  the  accuracy  of 
stairway  localization  within  the  map.  It  should  be  noted 
that  in  the  video  sequences  as  well  as  the  image  stills  in 
Fig.  2,  3D  meshes  were  available  for  some  of  the  buildings 
being  observed,  and  in  our  visualizations,  those  models  were 
aligned  with  the  underlying  map,  and  not  with  the  stairway 
model. 

We  can  accurately  localize  a  detected  and  modeled  stair¬ 
way  in  a  large  map  (See  Fig.  1),  and  over  many  ground- 
truthed  trials,  this  system  has  proven  to  be  accurate  in  the 
estimation  of  the  stairway  model’s  parameters  (See  Table 
I).  It  is  robust  to  false  positive  detections,  since  they  are 
removed  as  statistical  outliers  in  the  modeling  phase.  How¬ 
ever,  our  detector  has  also  proven  to  be  highly  accurate,  with 
only  a  handful  of  false  positive  frames  over  many  hours  of 
testing.  Despite  the  limitations  of  structured  light  sensors 
such  as  the  Microsoft  Kinect  in  outdoor  environments,  we 
found  that  in  many  circumstances  even  the  compromised 
depth  data  in  outdoor  settings  was  adequate  to  build  an 
accurate  model.  In  all  of  our  experiments  mapping  real- 
world  environments  containing  stairways,  this  system  was 
able  to  produce  an  accurately  localized  model  with  sufficient 
parameter  estimates  for  the  robot  to  determine  whether  the 
stairway  is  traversable  (See  Fig.  2).  Thus,  in  an  autonomous 
exploration  scenario,  stairways  in  the  environment  can  be 
localized  during  the  process  of  mapping  the  initial  floor  of  a 
building,  which  represents  a  first  step  toward  exploration  of 
buildings  with  multiple  floors. 
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